
Europaisches Paten tarn t 
European Patent Office 
Office europeen des brevets 




(11) Publication number : 0 626 770 A2 



EUROPEAN PATENT APPLICATION 



@ Application number : 94303627.7 
<g) Date of filing : 20.05.94 



@ int ci. 6 H04J 3/16, G11B 20/00 



(So) Priority : 25.05.93 JP 122269/93 

© Date of publication of application : 
30.11.94 Bulletin 94/48 

© Designated Contracting States : 
DE FR GB 

© Applicant : SONY CORPORATION 
6-7-35 Kitashinagawa 
Shinagawa-ku 
Tokyo 141 (JP) 



§) Inventor: Fujinami, Yasushl, c/o Intellectual 
Property Div. 
Sony Corporation, 
6-7-35 Kitashinagawa 
Shinagawa-ku, Tokyo 141 (JP) 
Inventor : Veltman, Markus Hendrikus, c/o Int 
Property Div. 
Sony Corporation, 
6-7-35 Kitashinagawa 
Shinagawa-ku, Tokyo 141 (JP) 

m) Representative : Pilch, Adam John Michael et 
al 

D. YOUNG & CO., 
21 New Fetter Lane 
London EC4A 1DA (GB) 



3! 



CO 



UJ 



© Data multiplexers and demultiplexers. 

© A data demultiplexer (5) for separating mul- 
tiplex data including coded video data, coded 
audio data, timing data (DTSV) indicative of a 
video decoding start time, timing data (DTSA) 
indicative of an audio decoding start time, and 
timing data (SCR) indicative of a system dock 
reference time. The demultiplexer (5) comprises 
a circuit (21) for separating the multiplex data 
into the component data, and comparators 
(23,25) for comparing input data with the refer- 
ence timing data. When the timing data (DTSV) 
indicative of a video decoding start time is 
inputted and detected, the video data is written 
in a video code buffer (6) at the maximum 
transfer rate. During such time period, the refer- 
ence timing data (STC) indicative of the current 
time is monitored, and the operation of decod- 
ing the video data is started when the reference 
timing data has become equal to the video 
- timing data (DTSV):"A"simffar operation is~per~ 
formed with regard to the audio data as well, so 
that the video and audio data can be inputted 
fast consequently to enhance the responsivrty 
at the start of reproduction. 
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The present invention relates to data demultiplex- 
ers and demultiplexing methods such as those for re- 
producing time-division multiplex data recorded on an 
optical disk or the like and separating the same into 
video data and audio data. 5 

Fig. 5 of the accompanying drawings is a block di- 
agram showing an exemplary constitution of a previ- 
ously-proposed data demultiplexer. In this diagram, a 
drive 1 reproduces the data recorded on an optical 
disk incorporated therein. On this optical disk, there 10 
are recorded both video data and audio data in a time- 
division multiplex form. The reproduced data output- 
ted from the drive 1 is supplied to a demodulator 2 so 
as to be demodulated. An error correction (ECC) cir- 
cuit 3 detects and corrects any error in the data out- is 
putted from the demodulator 2 and supplies the proc- 
essed data to a ring buffer 4. The ring buffer 4 stores 
a predetermined amount of the supplied data therein 
and subsequently outputs the data to a data demulti- 
plexer 5. 2Q 

The data demultiplexer 5 has a data separation 
circuit 21 which demultiplexes the data supplied from 
the ring buffer 4 thereby to separate the same into vid- 
eo data and audio data, and further into timing data 
such as SCR (system clock reference) and DTS (de- 25 
coding time stamp) inclusive of DTSV for the video 
data and DTSA for the audio data. 

The format of the data suppl ied to the data demul- 
tiplexer 5 may be standardized as shown in Fig. 6. 
This format is prescribed as a multiplex bit stream in 30 
the MPEG (IS01 11 72 standard). As shown in Fig. 6, a 
multiplex bit stream is composed of one or more 
packs (PACKS), each of which is composed of one or 
more packets (PACKETS). A pack header (PACK 
HEADER) is disposed at the top of each packand has 35 
a pack start code (PACK START CODE) indicating a 
start point of the pack, and also SCR and MUX RATE. 
This SCR indicates the time when the last byte is in- 
putted to the data demultiplexer 5 (the time when de- 
multiplexing is started), and the MUX__RATE signifies ao 
a transfer rate. 

In the example of Fig. 6, a video packet (VIDEO 
PACKET) and an audio packet (AUDIO PACKET) are 
disposed next to the pack header. A packet header is 
deposed at the top of each of such packets and has 45 
a video packet start code (VIDEO PACKET START 
CODE) or an audio packet start code (AUDIO PACK- 
ET START CODE) Indicating a rst^T^iht^thevtdeo 



or audio packet, and further has DTSV or DTSA indi- 
cating a decoding start time of the video or audio data. 50 
Video data or audio data is disposed next to each 
packet header. However, since the amount of video 
data per unit time is greater than that of audio data, 
the video timing data DTSV is disposed at a rate of 
once per plural packs. 55 

Such timing data of SCR and DTS (DTSV or 
DTSA) are represented by count values of 90-kHz 
clock pulses and have 33-bit effective digits. 



The video data is supplied to a video code buffer 
6 (FIFO). Meanwhile the audio data is supplied to an 
audio code buffer 8 (FIFO). The reference timing data 
SCR is supplied to an STC register 26 to be stored 
therein. The STC register 26 counts 90-kHz clock 
pulses outputted from a dock generator 27 and incre- 
ments its storage value to generate an STC (system 
time clock) signal. 

The timing data DTSV and DTSA are supplied to 
a DTSV register 22 and a DTSA register 24 respeo- 
tively so as to be stored therein. The timing data thus 
stored in the DTSV register 22 and the DTSA register 
24 are supplied to comparators 23 and 25 respective- 
ly so as to be compared with the STC signal outputted 
from the STC register 26. A control circuit 28 consists 
of a CPU or the like and serves to control the data 
separation circuit 21 in response to a command re- 
ceived from an input unit 29 by a user's manipulation. 

The video data stored in the video code buffer 6 
is read out therefrom and is supplied to a video decod- 
er 7. The video data is then decoded to form a video 
signal, which is subsequently outputted to an un- 
shown circuit. To the video decoder 7, there is also 
supplied a video decoding start signal which is output- 
ted from the comparator 23. 

Similarly, the data outputted from the audio code 
buffer 8 is supplied to an audio decoder 9 so as to be 
decoded. To the audio decoder 9, there is also sup- 
plied the output of the comparator 25 as an audio de- 
coding start signal. 

The operation will be described below with refer- 
ence to the timing chart of Fig. 7. First the input unit 
29 is manipulated for instructing the control circuit 28 
to start reproduction. Then the control circuit 28 
sends a command to the drive 1 thereby to reproduce 
the data recorded on an optical disk incorporated in 
the drive 1. The reproduced data outputted from the 
drive 1 is supplied to the demodulator 2, and the de- 
modulated data obtained therefrom is supplied to the 
ECC circuit 3 where a process of error detection and 
correction is executed. The data thus processed is 
supplied via the ring buffer 4 to the data separation 
circuit 21 in the data demultiplexer 5. 

The data separation circuit 21 is controlled by the 
control circuit 28 and separates the output data of the 
ring buffer 4 into video data and audio data, which are 
then supplied to the video code buffer 6 andJhe audio 



code buffer 8 respectively. The circuit 21 further sep- 
arates the timing data into SCR, DTSV and DTSA, 
which are supplied respectively to the STC register 
26, the DTSV register 22 and the DTSA register 24 
and then are stored therein. 

The STC register 26 having stored the timing data 
SCR therein counts the clock pulses outputted from 
the clock generator 27 and increments the storage 
value in response to the dock pulses. The storage val- 
ue of the STC register 26 is supplied as a system time 
dock (STC) signal to the comparators 23 and 25. 
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The DTSV register 22 holds the video timing data 
DTSV supplied first thereto after the start of repro- 
duction by the drive 1 . Consequently, the register 22 
comes to have a decoding start time relative to a top 
picture out of the entire data stored in the video code 
buffer 6. 

Similarly, the DTSA register 24 holds the audio 
timing data DTSA supplied first thereto after the start 
of reproduction, so that the register 24 comes to have 
a decoding start time relative to a top decode unit out 
of the entire data stored in the audio code buffer 8. 

The reference timing data SCR corresponds to 
the time when demultiplexing is started after supply 
of the data from the ring buffer 4 to the data demulti- 
plexer 5. More specifically, it corresponds to a time tl 
in the timing chart of Fig. 7. Therefore the STC regis- 
ter 26 outputs the time data (current time) from the 
time tl to one input terminal of each of the compara- 
tors 23 and 25. 

The DTSV register 22 supplies the video timing 
data DTSV, which indicates the decoding start time of 
the video decoder 7, to the other input terminal of the 
comparator 23. When the current time outputted from 
the STC register 26 has become coincident with the 
decoding start time outputted from the DTSV register 
22 (i.e., at a time t2 in Fig. 7), the comparator 23 out- 
puts a video decoding start signal to the video decod- 
er 7. In response to the video decoding start signal 
thus received, the video decoder 7 reads out one 
frame of the video data written in the video code buf- 
fer 6 and then starts its decoding. 

In Fig. 7, a straight line A represents a state of 
writing the data in the video code buffer 6 (with an in- 
clination signifying a write and transfer rate), and a 
broken line B represents a state of reading out the 
data from the video code buffer 6 by the video decod- 
er 7. It follows, therefore, that the data within a shaded 
area in Fig. 7 is left in the video code buffer 6. The 
storage capacity of the video code buffer 6 is ex- 
pressed by a perpendicular distance between the 
straight line A and another straight line C. 

The video decoder 7 starts its decoding in re- 
sponse to the video decoding start signal supplied 
thereto and generates a video vertical synchronizing 
signal upon completion of the decoding, i.e., after a 
lapse of a video decode delay (VIDEO-DECODE-DE- 
LAY) from the start of the decoding, and then outputs 
a video signal insuccess ion thereto. More specificaP 
ly, a display is started after a lapse of the video de- 
code delay from the start of the decoding. 

Similarly, the comparator 25 outputs an audio 
decoding start signal when the current time outputted 
from the STC register 26 has become coincident with 
the audio decoding start time outputted from the 
DTSA register 24. The audio decoder 9 reads out the 
data from the audio code buffer 8 in response to the 
audio decoding start signal and starts its decoding. 
An audio signal generated as a result of such decod- 



ing is outputted to an unshown circuit 

The above is the operation performed when the 
transfer rate is fixed. Fig. 8 shows a timing chart of 
signals in the case of adopting a variable transfer 
5 rate. A high rate mode of 8 Mbps is selected in the op- 
eration before a time t3 and after a time t6, and a low 
rate mode of 2 Mbps is selected during a period be- 
tween the times t3 and t6. The latter transfer rate is 
designated when the data are encoded by an un- 
to shown encoder. 

In Fig. 8, a broken line D represents a state of 
writing the data in the video code buffer 6, and its in- 
clination signifies a transfer rate. Another broken line 
F represents a state of reading out the data from the 
15 video code buffer 6 by the video decoder 7. It follows, 
therefore, that the data within a shaded area in Fig. 8 
is left in the video code buffer 6. The storage capacity 
of the video code buffer 6 is expressed by a perpen- 
dicular distance between the straight line D and an- 
20 other straight line E. 

In the lower diagram of Fig. 8 (an enlarged view 
of the period from time t3 to time t4), a picture W is a 
subject to be noted now as an example. The data of 
the picture W begins to be loaded in the video code 
25 buffer 6 at the ti me t4, which isindicated by thetiming 
data SCR affixed to the pack where the head G of the 
data of the picture W is stored. The data of the picture 
W begins to be decoded at a time t5 f which is indicat- 
ed by the timing data DTSV aff ixed to the packet 
30 where the head of the picture W is stored. 

The input unit 29 is manipulated for instructing 
the control circuit 28 to start reproduction of the data 
from the picture W. The control circuit 8 sends a com- 
mand to the drive 1, which then accesses a desired 
35 position on the optical disk incorporated therein and 
reproduces the recorded data. The reproduced data 
outputted from the drive 1 is supplied to the demod- 
ulator 2 so as to be demodulated, and the output 
therefrom is supplied to the ECC circuit 3 where a 
40 process of error detection and correction is executed. 
The data thus processed is supplied via the ring buf- 
fer 4 to the data separation circuit 21 in the data de- 
multiplexer 5. 

Data MUX_RATE is disposed at the top of each 
45 pack, so that the transfer rate of the relevant pack can 
be detected by referring to this data. For example, the 
data separation circuit 21 controls the transfer rate in 

accordance with the valuer of this data. As to controt 

of variable rate data, an exemplary description is dis- 
50 closed in UK Patent No. GB-A-2 259 229 (Date of pub- 
lication: March 3, 1993). 

The data separation circuit 21 controlled by the 
control circuit 28 separates the video data from the 
output data of the ring buffer 4 and supplies the video 
55 data to the video code buffer 6. The circuit 21 further 
separates the timing data into SCR and DTSV, which 
are then supplied to the STC register 26 and the 
DTSV register 22 respectively and are stored therein. 
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Since the operation of the audio section is similar to 
that mentioned above, further description will be 
omitted. 

The STC register 26 having stored the reference 
timing data SCR therein counts the dock pulses out- s 
putted from the clock generator 27 and increments 
the storage value in response to the clock pulses. The 
storage value of the STC register 26 is supplied as a 
system time clock (STC) signal to the comparators 23 
and 25. 

The timing data SCR corresponds to the time 
when demultiplexing is started after supply of the data 
of the picture W to the data demultiplexers. Morespe- 
cifically, it corresponds to a time t4 in the timing chart 
of Fig. 8. Therefore the STC register 26 outputs the 15 
timing data (current time) from the time t4 to one input 
terminal of each of the comparators 23 and 25. 

The DTSV register 22 supplies the video timing 
data DTSV, which indicates the picture-W decoding 
start time of the video decoder 7, to the oth er input ter- 20 
minal of the comparator 23. When the current time 
outputted from the STC register 26 has become co- 
incident with the decoding start time outputted from 
the DTSV register 22 (i.e., at a time t5 in Fig. 8), the 
comparator 23 outputs a video decoding start signal 25 
to the video decoder 7. In response to the video de- 
coding start signal thus received, the video decoder 
7 reads out one frame of the video data written in the 
video code buffer 6 and then starts its decoding. 

In the previously-proposed demultiplexer of Fig. so 
5, as described, the time period from SCR (t4) to DTS 
(t5) is controlled by counting clock pulses of a fixed 
frequency, and the data are written in the buffer dur- 
ing such time period. Consequently, the data transfer 
rate is fixed at one value designated on the encoder 35 
side, so that it has been impossible heretofore to 
shorten the start-up delay even when the data supply 
rate to the demultiplexer 5 is lower than the maximum 
transfer rate and a margin thereof is still left 

According to a first aspect of the present inverv 40 
tion, there is provided a data demultiplexer for sepa- 
rating multiplex data which includes at least first cod- 
ed data such as video data, first timing data indicative 
of a decoding start time of the first coded data, and 
second timing data indicative of a system dock refer- 45 
ence time. The demultiplexer comprises a separation 
means for separating the multiplex data into the first 

codeddatar the first timing da&and the second tim- 

ing data; and a comparison means for comparing the 
time, which is indicated by the first timing data sepa- so 
rated by the separation means, with the time indicat- 
ed by the second timing data; wherein, when the time 
indicated by the second timing data is temporally an- 
terior to the time indicated by the first timing data, the 
multiplex data is supplied at the maximum transfer 55 
rate to the separation means. 

The data demultiplexer preferably comprises a 
system time dock generation means for generating a 



system time clock signal by setting an initial value 
thereof on the basis of the first timing data and then 
incrementing predetermined clock pulses; and a 
means for generating a first decoding start signal by 
comparing the first timing data with the system time 
clock signal. 

The multiplex data further preferably includes 
second coded data such as audio data, and third tim- 
ing data indicative of a decoding start time of the sec- 
ond coded data. The demultiplexer preferably com- 
prises a means for generating a second decoding 
start signal by comparing the third timing data with the 
system time clock signal. 

According to a second aspect of the present in- 
vention, there is provided a data demultiplexer for 
separating multiplex data which includes at least first 
coded data such as video data, first timing data indi- 
cative of a decoding start time of the first coded data, 
second coded data such as audio data, and second 
timing data indicative of a decoding start time of the 
second coded data. The demultiplexer comprises a 
separation means for separating the multiplex data 
into the first coded data, the first timing data, the sec- 
ond coded data and the second timing data; and a 
comparison means for comparing the time, which is 
indicated by the first timing data separated by the 
separation means, with the second timing data; 
wherein the separation means does not supply the 
second coded data when the time indicated by the 
second timing data is temporally anterior to the time 
indicated by the first timing data. 

According to a third aspect of the present inven- 
tion, there is provided a data demultiplexing method 
for separating multiplex data which includes at least 
first coded data such as video data, first timing data 
indicative of a decoding start time of the first coded 
data, and second timing data indicative of a system 
clock reference time. The demultiplexing method 
comprises the steps of: separating the multiplex data 
into the first coded data, the first timing data and the 
second timing data; comparing the time, which is in- 
dicated by the separated first timing data, with the 
time indicated by the second timing data; and reading 
out the multiplex data from a buffer at the maximum 
transfer rate when the time indicated by the second 
timing data is temporally anterior to the time indicated 
by the first timing data. 



The data demultiplexing method preferably com- 
prises the step of generating a system time dock sig- 
nal by setting an initial value thereof on the basis of 
the first timing data and then incrementing predeter- 
mined dock pulses. 

The demultiplexing method further preferably 
comprises the step of generating a decoding start sig- 
nal by comparing the first timing data with the system 
time dock signal. 

The multiplex data may indude second coded 
data such as audio data, and third timing data indica- 
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tlve of a decoding start time of the second coded data. 
The demultiplexing method may then comprise the 
step of generating a second decoding start signal by 
comparing the third timing data with the system time 

clock signal. 

According to a fourth aspect of the present inven- 
tion, there is provided a data demultiplexing method 
for separating multiplex data which includes at least 
first coded data such as video data, first timing data 
indicative of a decoding start time of the first coded 
data, second coded data such as audio data, and sec- 
ond timing data indicative of a decoding start time of 
the second coded data. The demultiplexing method 
comprises the steps of: separating the multiplex data 
into the first timing data, the first coded data, the sec- 
ond coded data, and the second timing data; compar- 
ing the time, which is indicated by the separated first 
timing data, with the time indicated by the second tim- 
ing data; and supplying none of the second coded 
data to a decoder when the time indicated by the sec- 
ond timing data is temporally anterior to the time in- 
dicated by the first timing data. 

The video timing data DTSV is preferably com- 
pared with the reference data SCR by the comparison 
means. In accordance with the result of such compar- 
ison, the video and audio data can be inputted at a 
higher transfer rate designated in the bit stream, 
hence enhancing the responsivity at the start of re- 
production. 

Thus a preferred embodiment of the present in- 
vention can provide an improvement which is capable 
of enhancing the responsivity of the demultiplexing 
system by shortening the start-up delay. 

The invention will now be described by way of ex- 
ample with reference to the accompanying drawings, 
throughout which like parts are referred to by like ref- 
erences, and in which: 

Fig. 1 is a block diagram showing an exemplary 
constitution of a data demultiplexer according to 
a first embodiment of the present invention; 
Fig. 2 is a timing chart of signals in the first em- 
bodiment of Fig. 1 ; 

Fig. 3 is a previous timing chart of signals for com- 
parison with Fig. 2; 

Fig. 4 is a block diagram showing an exemplary 
constitution of a data demultiplexer according to 
a second embodiment of the invention; 
Fig. 5 is a block diagram showing an exemplary 
constitution of a previously-proposed data de- 
multiplexer in the related art; 
Fig. 6 is an explanatory diagram of a multiplex bit 
stream in the example of Fig. 5; 
Fig. 7 is a timing chart of signals for explaining the 
operation of the example shown in Fig. 5; and 
Fig. 8 is a timing chart of signals for explaining the 
operation at a variable transfer rate in the exam- 
ple of Fig. 5. 

Fig. 1 is a block diagram showing an exemplary 
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constitution of a first embodiment representing the 
data demultiplexer, wherein any like component cir- 
cuits or elements corresponding to those in the afore- 
mentioned example of Fig. 5 are denoted by the same 
reference numerals. In this first embodiment, a data 
demultiplexer 5 comprises a data separation circuit 
21, a DTSV register 22, a DTSA register 24, compar- 
ators 23 and 25, an STC register 26, a dock generator 
27. an SCR register 31 , and switch circuits 51 , 52, 53 
and 54. 

The output of the DTSV register 22 is supplied to 
the comparator 23 while being also supplied to one in- 
put terminal al of the switch circuit 51. Similarly, the 
output of the DTSA register 24 is supplied to the com- 
parator 25 while being also supplied to another input 
terminal a2 of the switch circuit 51. The output ob- 
tained from an output terminal b of the switch circuit 
51 is supplied to the STC register 26 so as to be stored 
therein. The STC register 26 counts clock pulses of 
90 kHz produced from the clock generator 27 and in- 
crements its storage value thereby to generate a sys- 
tem time clock STC. The STC thus outputted from the 
STC register 26 is connected to an input terminal c2 
of the switch circuit 52. 

To the SCR register 31 , there is supplied a system 
clock reference SCR separated as timing data by the 
data separation circuit 21 . The output of the SCR reg- 
ister 31 is connected to another input terminal cl of the 
switch circuit 52. 

An output terminal d of the switch circuit 52 is con- 
nected to another input terminal of each of the com- 
parators 23 and 25. 

The output of the comparator 23 is connected to 
an input terminal e of the switch circuit 53. One output 
terminal f I of the switch circuit 53 is connected to a vid- 
eo decoder 7, while another output terminal f2 thereof 
is connected to a control circuit 28. 

Similarly, the output of the comparator 25 is con- 
nected to an input terminal g of the switch circuit 54. 
One output terminal hi of the switch circuit 54 is con- 
nected to an audio decoder 9, while another output 
terminal h2 thereof is connected to the control circuit 
28. 

The switch circuits 51, 52, 53 and 54 are control- 
led by the control circuit 28. 

The operation of the first embodiment will now be 
described. First the input unit 29 is manipulated for in- 
~sl ructmg the con trot crrcuit 28 to start reproduction of 
an optical disk. In this stage, the control circuit 28 sets 
the data demultiplexer 5 in its initialize mode. More 
specifically, the switch circuit 52 is closed through the 
contact d so that the output of the SCR register 31 is 
supplied to the comparators 23 and 25. Meanwhile 
the switch circuit 53 is closed through the contact f2, 
and the switch circuit 54 is closed through the contact 
h2 so that the resultant outputs of the comparators 23 
and 25 are supplied to the control circuit 28. 

The data separation circuit 21 is controlled by the 
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control circuit 28 and separates the output data of a 
ring buffer 4 into video data and audio data, which are 
then supplied to a video code buffer 6 and an audio 
code buffer 8 respectively. The circuit 21 further sep- 
arates the timing data into SCR, DTSV and DTSA, s 
which are then supplied to the SCR register 31, the 
DTSV register 22 and the DTSA register 24 respec- 
tively so as to be stored therein. 

The SCR register 31 stores the latest one of the 
reference timing data SCR supplied thereto succes- 10 
sively and outputs the stored data therefrom. The 
DTSV register 22 holds the video timing data DTSV 
supplied first thereto after the start of reproduction. 
Consequently, the DTSV register 22 has a decoding 
start time relative to a top picture out of the entire data 15 
stored in the video code buffer 6. 

Similarly, the DTSA register 24 holds the audio 
timing data DTSA supplied first thereto after the start 
of reproduction. Consequently, the register 24 has a 
decoding start time relative to a top decode unit out 20 
of the entire data stored in the audio code buffer 8. 

The switch circuit 52 is closed through the contact 
cl in response to a command from the control circuit 
28, so that the outputs of the DTSV register 22, the 
DTSA register 24 and the SCR register 31 are sup- 25 
plied respectively to the comparators 23 and 25. 

The start of reproduction from a picture W and a 
flow of the data will be described below with reference 
to Figs. 2 and 3. For comparison, Fig. 3 shows the tim- 
ing explained in connection with the example of the 30 
related art 

In response to a command received from the in- 
put unit 29 for a start of reproduction, the control cir- 
cuit 28 sends a command to the drive 1 to perform re- 
production, so that the data is reproduced from the 35 
optical disk incorporated in the drive and is supplied 
to the demodulator 2 to be thereby demodulated. The 
data thus demodulated is supplied to the ECC circuit 
3 where a process of error detection and correction is 
executed, and subsequently the processed data is 40 
supplied via the ring buffer 4 to the data separation 
circuit 21. 

Assuming here that, at a time t7 in Fig. 2 (time t4 
in Fig. 3), the first data including a picture W is sup- 
plied from the ring buffer 4 to the data separation cir- 45 
cuit 21, the video data beginning with the picture W 
is supplied to the video code buffer 6, while the mul- 
tiplex- audio data ^supplied to the audio code buffer 

8 simultaneously. 

The video timing data DTSV indicating a picture- so 
W decoding start time is separated by the data sep- 
aration circuit 21 and is supplied to the DTSV register 
22, which then holds the DTSV of the picture W and 
outputs the same therefrom. Since the picture- W de- 
coding start time is t8 in Fig. 2 (time t5 in Fig. 3). its 55 
value is held in the DTSV register 22 and then is fed 
to one input terminal of the comparator 23. 

Similarly, the DTSA register 24 holds the audio 



timing data DTSA supplied thereto first, and then out- 
puts the same therefrom. 

It is supposed in this embodiment that the video 
timing data DTSV has a smaller value than the audio 
timing data DTSA (i.e., the video data begins to be de- 
coded temporally anterior to the audio data). 

The reference timing data SCR recorded at the 
top of each pack is supplied to the SCR register 31. 
The SCR register 31 holds the latest one of the data 
SCR supplied thereto successively and then outputs 
the same therefrom. Since the first pack of the picture 
W is supplied at a time t7 (time t4 in Fig. 3), the ref- 
erence timing data SCR supplied to the SCR register 
31 starts at t7 (t4 in Fig. 3). 

Immediately after initial supply of the data (J = t7 
in Fig. 2), the output of the SCR register 31 is smaller 
than the output of the DTSV register 22. The control 
circuit 28 monitors the output of the comparator 23 
and supplies the data from the ring buffer 4 at the 
maximum rate to the data separation circuit 21 during 
the period in which the output of the comparator 23 
signifies the above relation between the outputs of 
the SCR register 31 and the DTSV register 22. As will 
be apparent from a comparison between Figs. 2 and 
3, the transfer rate of the data inputted to the data 
separation circuit 21 (i.e., to the video code buffer 6) 
at the time t7 (t4) is higher in Fig. 2 than in Fig. 3. 

At the time t8 (i.e., at t5 in Fig. 3) after a lapse of 
time (with advance of writing in the video code buffer 
6), the data required for decoding the picture W is 
written in the video code buffer 6, so that the refer- 
ence time data SCR supplied thereafter becomes 
greater than the video timing data DTSV for the pic- 
ture W. At this stage, the comparator 23, which is 
comparing the output of the DTSV register 22 with the 
output of the SCR register 31, informs the control cir- 
cuit 28 that the value of the SCR register 31 has be- 
come greater than the value of the DTSV register 22. 

Then the control circuit 28 sets the data demulti- 
plexer 5 in its decode mode. Subsequently the data 
demultiplexer 5 interrupts its operation of inputting 
the data from the ring buffer 4 and changes the inter- 
nal state in such a manner that the switch circuit 51 
is closed through the contact al and the output (t8) of 
the DTSV register 22 is inputted and held in the STC 
register 26. Thereafter the switch circuit 52 is closed 
through the contact c2, and the output (t8) of the STC 
register 26 is supplied" to the comparators 23 and 25. 

The switch circuit 53 is dosed through the contact 
fl while another switch circuit 54 is closed through the 
contact hi, so that the outputs of the comparators 23 
and 25 are fed to the video decoder 7 and the audio 
decoder 9, respectively. 

After such change of the internal state, the data 
demultiplexer 5 resumes its operation of inputting the 
data. Simultaneously therewith, the STC register 26 
starts its count (increment) at the time t8. The com- 
parator 23 compares the output DTSV of the DTSV 
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register 22 (t8 in this stage) with the count value STC 
of the STC register 26 (which increases successively 
from t8). When the result of such comparison signi- 
fies that the STC Is equal to or greater than the DTSV, 
a video decoding start signal is generated and output- 
ted to the video decoder 7, which then starts decoding 

the video data. 

Similarly, the comparator 25 compares the out- 
put of the DTSA register 24 with the output of the STC 
register 26. When the result of such comparison sig- 
nifies that the STC is equal to or greater than the 
DTSV, an audio decoding start signal is generated 
and outputted to the audio decoder 9, which then 
starts decoding the audio data. 

In the embodiment mentioned above, the video 
decoding start time (DTSV) is temporally earlier than 
the audio decoding start time (DTSA). However, the 
same operation can still be performed If the DTSA is 
earlier. 

Although in the above embodiment the timing 
data DTSV and DTSA are used to indicate the video 
and audio decoding start times, it is also possible to 
employ different timing data PTS (presentation time 
stamp). This PTS is disposed in packet headers of 
partial packets, and its value indicates the time when 
the portion beginning with the first access unit in the 
relevant packet is to be displayed. In the audio data, 
the PTS and the DTS have the same value so as to 
be interchangeable by a simple calculation in the vid- 
eo data. 

In the previously-proposed apparatus, as descri- 
bed above, the time period from the SCR to the DTS 
is calculated by counting clock pulses of a fixed fre- 
quency, and the data is written in the video code buf- 
fer 6 during such time period. Consequently, the data 
transfer rate is determined by the clock frequency to 
be eventually rendered low. 

However, in the above embodiment of the pres- 
ent invention, the data can be written in the video 
code buffer 6 at the maximum transfer rate when the 
DTS of a desired picture is inputted; then the SCR of 
the data stored in the buffer 6 is compared with the 
DTS successively, and a decision is made, on the ba- 
sis of the result of such comparison, as to whether a 
required amount of the data for decoding the relevant 
picture has been written or not (whether the elapse 
has arrived at the decoding start time or not), whereby 
a fasf response can be achieved: 

Furthermore, when it is necessary to synchronize 
the system with a video synchronizing signal, the pur- 
pose is attainable by the following method in case the 
video decoding start time has priority over any other 
decoding start time (e.g.. audio decoding start time). 

Fig. 4 is a block diagram showing a second em- 
bodiment of the data demultiplexer, wherein any com- 
ponent circuits or elements corresponding to those 
used in Fig. 1 are denoted by the same reference nu- 
merals. In this second embodiment, timing data 



DTSV and DTSA separated by a data separation cir- 
cuit 21 are inputted to a DTSV register 22 and a DTSA 
register 24 respectively while being inputted also to 
a control circuit 28. Simultaneously a video synchron- 
5 izing signal is inputted to the control circuit 28. The re- 
mainder of the circuit is the same as that of the fore- 
going first embodiment shown in Fig. 1. 

The operation of the second embodiment will 
now be described. First an input unit 29 is manipulat- 
10 ed for instructing the control circuit 28 to start repro- 
duction. Then the control circuit 28 sets the data de- 
multiplexer 5 in its initialize mode. 

Now the start of reproduction from a picture W 
and a flow of the data wi II be described below with ref- 

15 erence to Fig. 2. 

Assume here that, at a time t7 in Fig. 2, the first 
data including a picture W is supplied from the ring 
buffer 4 to the data separation circuit 21. The video 
data beginning with the picture W is supplied to the 

20 video code buffer 6. Since the video data has a higher 
priority, the audio data is ignored in the earliest peri- 
od. More specifically, none of the audio data is sup- 
plied from the data separation circuit 21 to the audio 
code buffer 8. 

25 The video timing data DTSV indicating a decod- 

ing start time of the picture W is separated by the data 
separation circuit 21 and is supplied to both the DTSV 
register 22 and the control circuit 28. The DTSV reg- 
ister 22 holds the DTSV of the picture W and then out- 
30 puts the same therefrom. Since the picture-W decod- 
ing start time is t8 in this example, its value is held in 
the DTSV register 22 and is fed to one input terminal 
of the comparator 23. The control circuit 28 holds this 
video timing data DTSV (t8) therein. 
35 Similarly, audio timing data DTSA is separated 

by the data separation circuit 21 and is supplied to 
both the DTSA register 24 and the control circuit 28. 
Then the control circuit 28 compares the input audio 
timing data DTSA with the video timing data DTSV 
40 and, when the result of such comparison signifies that 
the data DTSA is smaller, the control circuit 28 con- 
trols the DTSA register 24 in such a manner as to ig- 
nore the timing data DTSA (i.e., not to hold the same 
in the DTSA register 24). Such operation of ignoring 
45 the timing data DTSA is performed also when the 
data DTSA is inputted to the control circuit 28 anterior 
to the data DTSV. However, when the timing data 
DTSA is greater than (temporally posterior to) the tim- 
ing data DTSV held in the register 22, the control cir- 
so cuit 28 instructs the DTSA register 24 to hold and out- 
put the data DTSA. The control circuit 28 further in- 
structs the data separation circuit 21 to supply the 
separated audio data to the audio code buffer 8. 
The reference timing data SCR recorded at the 
55 top of each pack is supplied to the SCR register 31 . 
Then the SCR register 31 holds the latest one of the 
data SCR supplied thereto successively and outputs 
the same therefrom. Since the pack of the picture W 

8 



<E P 0626770A2 I > 



13 



EP 0 626 770 A2 



14 



is supplied at the time t7, the reference timing data 
SCR supplied to the SCR register 31 starts at t7. 

Immediately after initial supply of the data (J = t7 
in Fig. 2), the output of the SCR register 31 is smaller 
than the output of the DTSV register 22 (at t8). The 
control circuit 28 supplies the data from the ring buffer 
4 at the maximum transfer rate to the data separation 
circuit 21 during the period in which the outputs of the 
two registers 31 and 22 have the above relationship 
therebetween. 

At the time t8, the reference timing data SCR be- 
comes greater than the video timing data DTSV of the 
picture W. At this stage of the operation, the compar- 
ator 23, which is comparing the output of the DTSV 
register 22 with the output of the SCR register 31 , in- 
forms the control circuit 28 that the value of the SCR 
register 31 has become greater. 

Then the control circuit 28 sets the data demulti- 
plexer 5 in its decode mode, whereby the internal 
state is switched in the same manner as in the afore- 
mentioned first embodiment of Fig. 1. 

For the purpose of synchronizing the video de- 
coder 7 with a video synchronizing signal, the control 
circuit 28 performs the following operation in syn- 
chronism with the video synchronizing signal inputted 
thereto. First the control circuit 28 enables the data 
demultiplexer 5 to resume its operation of inputting 
the data in synchronism with the video synchronizing 
signal. Simultaneously the STC register 26 starts its 
count (increment) and then generates and sends a 
video decoding start signal to the video decoder 7 as 
described above. 

Further the comparator 25 compares the output 
of the DTSA register 24 with the output of the STC reg- 
ister 26, and generates and sends a decoding start 
signal to the audio decoder 9 when the result of such 
comparison signifies that the STC is equal to or great- 
er than the DTSA 

Although in this embodiment the video decoder 7 
serves as a main decoder while the audio decoder 9 
is a subsidiary decoder, it is still possible to achieve 
the same operation regardless of which decoder 
serves as a main decoder. It will be apparent that the 
same desired result can be attained even if a plurality 
of kinds of subsidiary decoders or a plurality of main 
and subsidiary ones are employed. 

In each of the two embodiments mentioned 
a bove , the ~oompara1brs~231i^ 
as to keep performing the respective comparisons. 
However, the circuit configuration may be modified 
so that each comparison is executed after effective 
data is inputted to the DTSV register 22 or the DTSA 
register 24, whereby an accurate operation can be en- 
sured. 

As described hereinabove, timing data indicative 
of a decoding start time and timing data indicative of 
a reference time are compared with each other, and 
in conformity with the result of such comparison, the 



video and audio data can be inputted at a higher 
transfer rate designated in the bit stream, hence en- 
hancing the responsivity at the start of reproduction. 



Claims 



1. 



10 



15 



20 



25 



30 



A data demultiplexer for separating multiplex data 
which includes at least first coded data, first tim- 
ing data (DTSV) indicative of a decoding start 
time of the first coded data, and second timing 
data (SCR) indicative of a system clock reference 
time, said demultiplexer comprising: 

a separation means (21) for separating the 
multiplex data into the first coded data, the first 
timing data (DTSV) and the second timing data 
(SCR); and 

a comparison means (23) for comparing 
the time, which is indicated by the first timing 
data (DTSV) separated by said separation means 
(21), with the time indicated by the second timing 
data (SCR); 

wherein, when the time indicated by the 
second timing data (SCR) is temporally anterior 
to the time indicated by the first timing data 
(DTSV), the multiplex data is supplied at the max- 
imum transfer rate to said separation means (21). 



2. A data demultiplexer according to claim 1 , where- 
in said first coded data is coded video data. 



3. 



35 



40 



45 



50 



55 



A data demultiplexer according to claim 1 or claim 
2, comprising means (26,27) for generating a sys- 
tem time clock signal (STC) by setting an initial 
value thereof on the basis of the first timing data 
(DTSV) and then incrementing predetermined 
clock pulses. 

A data demultiplexer according to claim 3, com- 
prising means (23.53) for generating a first de- 
coding start signal by comparing the first timing 
data (DTSV) with the system time dock signal 
(STC). 



5. A data demultiplexer according to claim 3 or claim 
4, wherein the multiplex data further includes 
second coded data, and third ti ming data (DTSA). 
indicative of a decoding start time of the second 
coded data, and said demultiplexer comprises 
means (25,54) for generating a second decoding 
start signal by comparing the third timing data 
(DTSA) with the system time clock signal (STC). 

6. A data demultiplexer according to claim 5, where- 
in said second coded data is coded audio data. 

7. A data demultiplexer for separating multiplex data 
which includes first coded data, first timing data 
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(DTSV) indicative of a decoding start time of the 
first coded data, second coded data, and second 
timing data (DTSA) indicative of a decoding start 
time of the second coded data, said demultiplex- 
er comprising: 

a separation means (21 ) for separating the 
multiplex data into the first coded data, the first 
timing data (DTSV). the second coded data and 
the second timing data (DTSA); and 

a comparison means (23,25) for compar- 
ing the time, which is indicated by the first timing 
data (DTSV) separated by said separation 
means, with the second timing data (DTSA); 

wherein said separation means (21) does 
not supply the second coded data when the time 
indicated by the second timing data (DTSA) is 
temporally anterior to the time indicated by the 
first timing data (DTSV). 

8. A data demultiplexer according to claim 7, where- 
in said f irst coded data is coded video data, and 
said second coded data is coded audio data. 

9. A data demultiplexing method for separating mul- 
tiplex data which includes at least first coded 
data, first timing data (DTSV) indicative of a de- 
coding start time of the first coded data, and sec- 
ond timing data (SCR) indicative of a system 
clock reference time, said method comprising the 
steps of: 

separating (21) the multiplex data into the 
first coded data, the first timing data and the sec- 
ond timing data; 

comparing (23) the time, which is indicat- 
ed by the separated first timing data (DTSV). with 
the time indicated by the second timing data 

(SCR); and 

reading out the multiplex data from a buf- 
fer (4) at the maximum transfer rate when the 
time indicated by the second timing data (SCR) 
is temporally anterior to the time indicated by the 
first timing data (DTSV). 

10. A method according to claim 9, wherein said first 
coded data is coded video data. 

11. A method according to cJahrn 9 or claim 10, com- 
prising the ^tep of geherating~(26,277 a system 
time dock signal (STC) by setting an initial value 
thereof on the basis of the first timing data 
(DTSV) and then incrementing predetermined 
clock pulses. 

12. A method according to claim 11, comprising the 
step of generating a first decoding start signal by 
comparing the first timing data (DTSV) with the 
system time clock signal (STC). 



5 



10 



15 



20 



25 



30 



35 



40 



13. A method according to claim 11, wherein said 
multiplex data further includes second coded 
data, and third timing data (DTSA) indicative of a 
decoding start time of the second coded data, 
and said method comprises the step of generat- 
ing a second decoding start signal by comparing 
the third timing data (DTSA) with the system time 
clock signal (STC). 

14. A method according to claim 13, wherein said 
second coded data is coded audio data. 

15. a data demultiplexing method for separating mul- 
tiplex data which includes first coded data, first 
timing data (DTSV) indicative of a decoding start 
time of the first coded data, second coded data, 
and second timing data (DTSA) indicative of a de- 
coding start time of the second coded data, said 
demultiplexing method comprising the steps of: 

separating (21) the multiplex data into the 
first coded data, the first timing data (DTSV), the 
second coded data, and the second timing data 
(DTSA); 

comparing (23,25) the time, which is indi- 
cated by the separated first timing data (DTSV), 
with the time indicated by the second timing data 

(DTSA); and 

supplying none of the second coded data 
to a decoder when the time indicated by the sec- 
ond timing data (DTSA) is temporally anterior to 
the time indicated by the first timing data (DTSV). 

1 6. A method according to claim 1 5, wherein said first 
coded data is coded video data, and said second 
coded data is coded audio data. 
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